Tag: Data Engineering

2026-08-02 • Alex Merced

Apache Polaris 1.7.0 and the Quiet Work of Making a Catalog Trustworthy

Apache Polaris 1.7.0 deep dive: idempotent writes, semantic models, stricter credential vending, orphan cleanup, and wha...

2026-08-02 • Alex Merced

Designing Batch Pipelines That Write Well Into Apache Iceberg

How to design batch pipelines that write well into Apache Iceberg: commit strategy, partitioning, sort order, write-audi...

2026-07-28 • Alex Merced

Running an Apache Iceberg Lakehouse With No Internet Connection

A practical guide to deploying an Iceberg lakehouse in air-gapped environments: component choices, artifact pipelines, i...

2026-07-28 • Alex Merced

Why Iceberg V4 Wants to Retire Equality Deletes, and What Streaming Teams Should Do About It

Equality deletes made streaming upserts into Iceberg practical at the cost of read performance. V4 proposes retiring the...

2026-07-28 • Alex Merced

Surviving Commit Conflicts When Dozens of Writers Hit the Same Iceberg Table

Commit conflicts multiply with writer count, and AI agents introduce unpredictable write patterns. Here's how to diagnos...

2026-07-28 • Alex Merced

The Parquet Versioning Problem, and Why Iceberg Cares About It

Parquet files have a version field that doesn't reliably signal feature requirements. A new versioning discipline is com...

2026-07-13 • Alex Merced

Active Analytics Loops for AI Action Agents

An in-depth exploration of active analytics loops for ai action agents...

2026-07-13 • Alex Merced

Hybrid Lakehouse Design for Regulated Markets

An in-depth exploration of hybrid lakehouse design for regulated markets...

2026-07-13 • Alex Merced

Iceberg Concurrency for AI Agent Writes

An in-depth exploration of iceberg concurrency for ai agent writes...

2026-07-13 • Alex Merced

REST Catalog V2: Fixing Iceberg Protocol Debt

An in-depth exploration of rest catalog v2: fixing iceberg protocol debt...

2026-05-31 • Alex Merced

Data Platform Native AI Agent Tooling in 2026

A comprehensive comparison of AI agent tooling across Dremio, Snowflake, Databricks, Microsoft Fabric, AWS, Google Cloud...

2025-12-05 • Alex Merced

dremioframe & iceberg - Pythonic interfaces for Dremio and Apache Iceberg

Discover DremioFrame and IceFrame, two new Python libraries that simplify working with Dremio and Apache Iceberg. Learn ...

2025-11-29 • Alex Merced

Introducing dremioframe - A Pythonic DataFrame Interface for Dremio

Discover dremioframe, a new Python library that offers a DataFrame-like experience for interacting with Dremio's data la...

2025-11-12 • Alex Merced

Comprehensive Hands-on Walk Through of Dremio Cloud Next Gen (Hands-on with Free Trial)

Walkthrough with the new trial of the Dremio Cloud Platform...

2025-10-23 • Alex Merced

2025-2026 Guide to Learning about Apache Iceberg, Data Lakehouse & Agentic AI

A curated guide to mastering Apache Iceberg, data lakehouse architectures, and the emerging field of Agentic AI for data...

2025-10-21 • Alex Merced

An Exploration of the Commercial Iceberg Catalog Ecosystem

Dive into the world of commercial Iceberg catalogs and discover how they enhance data lakehouse architectures for modern...

2025-10-17 • Alex Merced

Building a Universal Lakehouse Catalog - Beyond Iceberg Tables

Exploring paths to a universal lakehouse catalog that supports multiple data formats and engines, building on Apache Ice...

2025-10-16 • Alex Merced

Intro to Apache Iceberg with Apache Polaris and Apache Spark

Learn how to leverage Apache Iceberg with Apache Polaris and Apache Spark to build scalable and efficient data lakehouse...

2025-10-14 • Alex Merced

The State of Apache Iceberg v4 - October 2025 Edition

What's Coming in Apache Iceberg v4: A Deep Dive into the Future of Open Table Formats...

2025-09-24 • Alex Merced

The Ultimate Guide to Open Table Formats - Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

Understanding Iceberg, Delta Lake, Hudi, Paimon, and DuckLake...

Events & Community

Agentic Lakehouse Events
Data Lakehouse Hub Events
Data Lakehouse Hub Slack
Data Events Slack
Data & Tech Slack
r/datalakehouseandai
Data Lakehouse Hub on LinkedIn
Alex Merced Tech
Alex Merced Data & AI

The views, thoughts, and opinions expressed on this site belong solely to Alex Merced and do not represent the views of any organization or employer.